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USE OF SOFT-DECISION OR SUM-PRODUCT INNER CODERS TO 
IMPROVE THE PERFORMANCE OF OUTER CODERS 

RELATED APPLICATIONS 

[000 1 ] This application claims the benefit under 35 U.S.C. Section 1 19(e) of 

United States Provisional Patent Application Serial No. 60/221,851, filed on July 28, 2000, 

incorporated herein by reference in its entirety. 

[0002] This application incorporates by reference the entire teachings of: U.S. 

Patent Application Ser. No. 09/846,061 entitled "Use of turbo-like codes for QAM modulation 

using independent I and Q decoding techniques and application to xDSL systems"; U.S. Patent 

Application PCT/US99/17369 entitled "Method and apparatus for design forward error 
q correction techniques in data transmission over communications systems"; and U.S. Provisional 
Jf{ Patent Application Ser. No. 09/702,827 entitled "Use of Turbo Trellis codes with QAM 

modulation for xDSL modems and other wired and wireless modems." 

ffk 

JJ FIELD OF THE INVENTION 

^ [0003] Embodiments of the invention pertain to encoder structures comprising an 

Q inner encoder, such as a Trellis Code Modulation (TCM), Turbo Code (TC) or Low Density 
l** Parity Check (LDPC) coder, and an outer encoder such as a Reed-Solomon (RS) encoder or 
O another outer encoder. Further embodiments pertain to a corresponding decoder structure 
comprising an inner decoder and an outer decoder, 

BACKGROUND TECHNOLOGY 

[0004] Turbo codes and other receiver soft-decision extraction techniques such as 
Low Density Parity Check Codes (LDPC), are powerful error control techniques that allow 
communication at very close to the channel capacity. Low Density Parity Check Codes were 
introduced in 1962. The sum-product algorithm is commonly used to decode LDPC codes. The 
sum-product algorithm sends information forward and backward between the information bits 
and the parity bits iteratively, until all the bits are decoder correctly or some bits are indentified 
as incorrectly decoded. Consequently the sum-product algorithm provides bit error information 
that indicates which outputted decoded bits have errors. 
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[0005] LDPC encoders and decoders are conventionally used alone, and are not 
conventionally used in dual inner/outer coder arrangements. The efficiency of LDPC coding 
increases with the number of coded bits, and so conventional LDPC implementations have 
typically used large block sizes (e.g. one megabit) for encoding in order to achieve nearly error 
free operation. However, since an entire block must be received before an LDPC decoder can 
decode the block, the use of large blocks can introduce significant delay into the system at the 
receiver. 

[0006] Turbo codes were introduced in 1993. Turbo-type decoders, referred to 
hereinafter as soft-output decoders, provide bit error probability information that indicates a 
probability of error for each of the decoded bits. 

[0007] The use of an outer coder, such as a Reed-Solomon (RS) coder, in 
conjunction with an inner coder, enables errors remaining from an inner coder to be corrected by 
yr| the outer coder. A RS decoder is able to correct up to R/2 errors without having information of 
r! the location of the errors. A RS decoder is able to correct up to R errors if the decoder knows 
|] where the errors are located. It is therefore desirable for an outer coder to have information 
gi indicating where errors are located. Thus the conventional outer decoder comprises two stages. 
m The first stage receives an output bit stream from an inner decoder and determines which of the 
0 received bits have errors. The second stage uses the information generated by the first stage to 
fll selectively correct errors in the output bit stream of the inner decoder. 

^ [0008] Examples of the use of inner and outer coders are found in the ADSL ITU 

H- recommendation G.992. 1 and in the Third Mobile Generation Standard UMTS 3GPP 3G TS 
25.212 V3.2.0. 

[0009] The following references are incorporated by reference as representing the 
conventional knowledge in the field of the invention: 

[00 1 0] R. G. Gallager, "Low Density Parity-Check Codes", IRE Trans, on 
Information Theory, pp. 21- 28, 01/62. 

[00 11] C. Berrou, V. Glavieux and P. Thitimajshima, 4< Near Shannon limit error- 
correcting coding and decoding: turbo-codes", ICC 1993, Geneva, Switzerland, pp. 1064-1070, 
May 1993. 
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[00 1 2] H. Feldman and D. V. Ramana, "An introduction to Inmarsat's New 
Mobile Multimedia Service", The Sixth International Mobile Satellite Conference, Ottawa, pp. 
226-229, June 1999. 

[00 1 3] P. Chaudhury, W. Mohr and S. Onoe, "The 3GPP Proposal for IMT- 
2000", IEEE Communications Magazine, vol. 37, no 12, pp.72-81. December 1999. 

[00 1 4] 3GPP Standard "Multiplexing and channel coding: TS 25.212" 

[00 1 5] C. D. Edwards, C. T. Stelzried, L. J. Deutsch and L. Swanson, "NASAS's 
deep-Space Telecommunications Road Map" TMO Progress Report 42-136, JPL, Pasadena, CA 
USA. PP. 1-20 February 1999. 

[00 1 6] R. Pyndiah, A. Picard and A. Glavieux "Performance of Block Turbo 
Coded 16 QAM and 64 QAM modulations" Procedings of Globecom 95 pp.1039-1043. 

[00 1 7] Rauschmayer, Dennis J. "ADSL/VDSL Principles", Macmillan Technical 
Publishing, 1999. 

[001 8] ITU G.992.1 "ADSL Transceivers", ITU, 1999. 

[00 1 9] ITU G.992.2 "Splitterless ADSL Transceivers". ITU 1999. 

[0020] ITU 1.432 "B-ISDN user-network interface-physical layer specification", 
ITU , 1993. 

[002 1 ] Benedetto, Divsalar, Montorsi and F. Pollara, "Serial Concatenation of 
Interleaved Codes: Performance Analysis, Design, and Iterative Decoding", The 
Telecommunications and Data Acquisition Progress Report 42-126, Jet Propulsion Laboratory, 
Pasadena, California, pp. 1-26, August 15, 1996. 

[0022] Benedetto, Divsalar, Montorsi and F. Pollara, "A Soft-Output Maximum 
A Posteriori (MAP) Module to decode parallel and Serial Concatenated Codes", The 
Telecommunications and Data Acquisition Progress Report 42-127, Jet Propulsion Laboratory, 
Pasadena, California, pp. 1-20, November 15, 1996. 

[0023] L. R. Bahl, J. Cocke, F. Jelinek, and J. Raviv, "Optimal Decoding of 
Linear Codes for Minimizing Symbol Error Rate," IEEE Transactions on Information Theory, 
pp. 284-287, March 1974. 

[0024] Divsalar and F. Pollara, "Turbo Codes for PCS Applications", Proceedings 
of ICC'95, Seattle, Washington, pp. 54-59, June 1995. 
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[0025] D. Divsalar and F. Pollara, "Multiple Turbo Codes", Proceedings of IEEE 
MILCOM95, San Diego, California, November 5-8, 1995. 

[0026] D. Divsalar and F. Pollara, "Soft-Output Decoding Algorithms in iterative 
Decoding of Turbo Codes," The Telecommunications and Data Acquisition Progress Report 
42-124, Jet Propulsion Laboratory, Pasadena, California, pp. 63-87, February 15, 1995. 

SUMMARY OF THE INVENTION 

[0027] Embodiments in accordance with the present invention are distinguished 
over conventional inner/outer coder schemes in that information regarding bit errors in the output 
of an inner decoder is provided by the inner decoder to the outer decoder, rather than being 
generated internally by the outer decoder. Thus, unlike conventional outer decoders, the outer 
decoder in accordance with preferred embodiments of the invention does not require a 

y3 conventional first stage for determining errors in the output bit stream of the inner decoder based 

lJ on the bits of the output bit stream themselves. 

j*j [0028] In a first preferred embodiment, a soft-output inner decoder is utilized in a 

pi conventional manner to generate a bit stream from a received symbol stream and to generate a bit 

i ffi 

J 8 error probabilities for each bit of its output bit stream. This bit error probabilities and the output 
O bit stream of the inner decoder are then provided to an outer decoder where errors in the output 
fu of the inner decoder are corrected in accordance with the bit error probabilities. 

[0029] In a second preferred embodiment, an LDPC coder is used as an inner 
r* encoder in a transmitter, and is used as an inner decoder in a receiver. Thus, unlike in 

conventional implementations, the LDPC coder is employed in an inner/outer coder scheme. In 
a receiver, the bit error information generated by the inner LDPC decoder is provided to an outer 
decoder where errors in the output of the inner LDPC decoder are corrected. Because a second 
stage of error correction is used, it becomes possible to reduce the block size utilized for the 
LDPC coding. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0030] Figure 1 shows elements of an ADSL transmitter and receiver that use 
inner and outer coders; 

[003 1 ] Figure 2 shows a Coding Scheme; 
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[0032] Figure 3 shows a SRC Scheme; 

[0033] Figure 4 shows BER curves for use of a Turbo coder as an inner encoder 
for the rate 4/6 64 QAM scheme in accordance with an embodiment of the invention; 

[0034] Figure 5 shows BER curves for use of a Turbo coder as an inner encoder 
for the rate 12/14 16384 QAM scheme in accordance with an embodiment of the invention; 

[0035] Figure 6 shows a process in accordance with a first preferred embodiment; 

[0036] Figure 7 shows a first process in accordance with a second preferred 
embodiment; and 

[0037] Figure 8 shows a second process in accordance with a second preferred 
embodiment. 



« DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

M 

1 . Introduction 

JJ: [0038] The preferred embodiments of the invention presented herein pertain to 

P encoder structures having an inner encoder comprising a soft-output coding scheme, such as 
T Trellis Code Modulation (TCM) or Turbo Code (TC), or a Low Density Parity Check (LDPC) 
£f coding scheme. An outer encoder in accordance with the preferred embodiments comprises a 
ftJ Reed-Solomon (RS) encoder. However, alternative embodiments may be implemented using 
q other inner encoders that provide bit error or bit error probability information, and using other 
^ outer encoders that utilize bit error or bit error probability information. 

[0039] A first preferred embodiment exploits features of a Maximum a Posteriori 
(MAP) decoder used as an inner soft-output decoder. The MAP decoder provides as output a bit 
stream and an error probability of each bit of the bit stream (referred to herein as bit error 
probability information). The bit error probability information is used in the outer decoder to 
facilitate greater error recovery in the outer decoder (in the case of RS codes this error recovery 
is doubled). This scheme is contrasted with conventional implementations such as conventional 
xDSL modems that employ an inner decoder for TCM that uses a Viterbi decoder. This provides 
only hard decisions as to the value of each output bit and outputs no probability or error 
information that can be used in the outer RS decoder. 
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[0040] For purposes of comparison, the preferred embodiments of the invention 
will be illustrated in the context an Asymmetric Digital Subscriber Line (ADSL) system using an 
outer encoder and an inner encoder. 

2. System model 

[0041 ] Figure 1 shows a system model of a communication system comprising 
transmitting and receiving ADSL modems, such as is described in the Recommendation G.992.1 
of the ITU. The system uses two dimensional multi-level signals for the inner encoder, as QAM. 
The transmitting modem 20 comprises a Reed-Solomon outer encoder 1, a byte interleaver 2, 
and an inner encoder 3 that produce an encoded bit stream from an input information bit stream. 
A signal-space mapper 4 maps the bit stream to symbols of a symbol constellation, and an 
inverse discrete Fourier transform module 5 modulates the symbols for transmission through a 
communication channel 6. In the receiving modem 30, a discrete Fourier transform module 7 
receives the modulated signal from the communication channel 6 and converts it to a received bit 
stream. The receiving modem further comprises an inner decoder 8, a byte de-interleaver 9, and 
a Reed-Solomon outer decoder 10. The output of the outer decoder 10 is a reconstructed 
information bit stream. 

3. Reed-Solomon (RS) encoder 

[0042] The RS outer encoder 1 of Figure 1 is used very often to correct burst- 
errors in communication channels, such as telephone lines, deep-space communications, satellite 
communications, mobile communications, and CD players. The characteristic of an RS code is 
that it can correct up to R/2 symbols, where R is the number of check symbols used by the RS 
encoder. 

[0043] R, the number of redundant check bytes cq 9 c\, ... , c^, cr.j shall be 
appended to K information bytes mo, m\ , ... , m^j^ m K-l to f orm a ^ codeword of size N = K 
+ R bytes. The check bytes are computed from the message byte using the equation: 

C(D)=M(D)D R mod G(D) (1) 

where: 
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M(D) = m 0 D K ' l +m l D K ' 2 +...+m K __ 2 D + m KA (2) 
is the message polynomial, 

C(D) = c 0 D R - 1 +c x D R - 2 +... + c R ^ 2 D + c R _ x (3) 
is the check polynomial, and 

G(Z») = n(D-a ! ) (4) 

is the generator polynomial of the Reed-Solomon code, where the index of the product runs from 
i = 0 to RA , That is, C(D) is the remainder obtained from dividing M(D) D# by G(D). The 
arithmetic is performed in the Galois Field GF(256), where a is a primitive element that satisfies 
the primitive binary polynomial x 8 + x 4 + x 3 + x 2 + 1 A data byte ( di, d^ y ... , d\, do) is identified 
with the Galois Field element dja 1 ^ af 6 a 6 +«.+di a+ do 

[0044] With this definition RS is able to correct up to R/2 symbols. If there are 
more than R/2 symbols with errors, RS will not be able to correct any of them. Because of this 
characteristic of RS, a high value for R is used, to make sure that the system is working error- 
free (assuming impulse noise of duration inferior to 0.5 ms). 

[0045] The values of the redundancy to work error free are around 10-15%. 

[0046] To improve the performance of the RS outer encoder, a byte interleaver 2 
is used as indicated in Figure 1. 



3. The soft-inner encoder-decoder 

[0047] In accordance with the first preferred embodiment, the inner encoder 3 of 
Figure 1 is a TC. Two examples are provided herein addressing the cases of 64 QAM and 16384 
QAM modulations to show how information about the probability of each symbol can be use to 
improve the performance of a RS outer encoder. The signal-space mapper 4 of Figure 1 in these 
cases provides independent I&Q QAM Gray mapping. 



3.1. Description of the method for implementation 
3.1.1 Capacity Bounds 
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[0048] The minimum Ei/No values to achieve the Shannon bound 64 QAM and 
16384 QAM bounds for spectral efficiencies of 4 and 12 bits/s/Hz respectively are as in Table 1 



foraBER=10" ; 



Table 1. Shannon bounds. 



Spectral efficiency r| 
[bit/s/Hz] 


Shannon bound 
Eb/No [dB] 


4 


5.6 


12 


24.7 



[0049] The conversion from SNR of the QAM signal to E b /N 0 is performed 
using the following relation: 

E b /N 0 [dB] = SNR [dB] - 10 log 10 (tj) [dB] (5) 
where r\ is the number of information bits per symbol. 



[0050] 



For a D-dimension modulation the following formulae are used: 



n yr _ E[\ai\] _ E[\dU _ E av 
E[\wl\] D a 2 N D a 2 N 



SNR = 



(6) 
(7) 



D 



No 



2 2 

where c? N is the noise variance in each of the D dimension and r\ is the number of information bits 
per symbol. From the above relations: 

(8) 



Cn Ea 



No 



3.1.2 Coding 

[005 1 ] The coding scheme is shown in Figure 2. The two systematic recursive 
codes (SRC) used are identical and are defined in Figure 3. The code is described by the 
generating polynomials 35o and 23 o. 



3.1.3 Turbo code internal interleaver. 
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[0052] The interleaver of this embodiment is an LRI interleaver. The interleaving 
sequence of the LRI is as follows: 

[0053] Determination of the interleaving buffer size. 
M: Number of column in the interleaving buffer (M > 1 6). 
N: Number of rows in the interleaving buffer (N > 16). 
BL: Interleaving block size (BL=PxP>= MxN). 
P : Minimum prime number that is larger than M. 
v: Minimum primitive root of P. 

[0054] Making basic random set whose length is M 

C(0) = 1 ; C(i+1) = vjc C(i) modP, i = 0,1, ....P-3 (9) 

* [0055] Making i-th inter-row permutation pattern. 

IP By shifting output of step 2 one by one per inter-row, a Latin square matrix is made. The 

5 last (M-l)th column is processed specially in order to avoid low namming weight phenomenon 

y 1 caused by the forced termination. 

pi CLj(i) = C(j + imodM-l) ; CLj(M-l)=0 ; i = 0,l,...M-2; j = 0 ,1,...,N-1 

% (10) 

U [0056] Row bv row 2D-mar>ping of di to MxN buffer. 

d*j(i)= i+Mxj , i = 0,l,...,M-2 ; j=0,l,...,N-l (11) 

[0057] Permutatine of 2D-mapned input set di bv the per mutation pattern made in 

point 3. 

d** j(i) =d* (N-j) (CL)N-j) (i)), , i = 0,1 M-l;j = 0,1,...,N-1 (12) 

[0058] Reading a permuted input set column bv column, and making output set. 
d'Q+Nxi) = d**j(i) , i = 0,l,...,M-l;j = 0,1,...,N-1 (13) 
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[0059] Pruning bits. 

d' is pruned by deleting the 1-bits in order to adjust the output d' to the input block length 
BL ? where the deleted bits are non-existent bits in the input sequence. The pruning number L is 
defined as L = MxN - BL. 

3.1.4. Coding And Modulation For 4 Bit/S/Hz Spectral Efficiency. 

3.1.4.1 Puncturing 

[0060] In order to obtain a rate 4/6 code, the puncturing pattern used is shown in 
Table 2. 



Table 2. Puncturing and Mapping for Rate 4/6 64 QAM 



Information bit (d) 


di 


d 2 


d 3 


d4 


parity bit (p) 


Pi 








parity bit (q) 










8AM symbol (I) 


(di, d 2 , pi) 


8AM symbol (Q) 


(d 3> d4> q3) 


64 QAM symbol (I,Q) 


( I ,Q)=(di,d 2 , pi,d 3 , d4,q 3 ) 



pi 

vn 



3.1.4.2 Modulation 

[006 1 ] In this embodiment Gray mapping is used in each dimension. Four 
information bits are required to be sent using a 64 QAM constellation. For a rate 4/6 code and 64 
QAM ? the noise variance in each dimension is 

E av = (8(49+25+9+1+25+49+49+9+49+1+25+9+25+1+9+1)) A 2 / 64= 42 A 2 



\ No 



No 



= 5.25 A 2 



(14) 
(15) 



[0062] The puncturing and mapping scheme is shown in Table 2 for 4 
consecutive information bits that are encoded into 6 coded bits, therefore one 64 QAM symbol. 
The turbo encoder with the puncturing presented in Table 2 is a rate 4/6 turbo code which in 
conjunction with 64 QAM gives a spectral efficiency of 4 bits/s/Hz. Considering two 
independent Gaussian noises with identical variance a 2 N , the LLR can be determined 
independently for each I and Q. It is assumed that at time k ui\ u 2 k and U3 k modulate the I 
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component and u/, us k and U6 k modulate the Q component of the 64 QAM scheme. At the 
receiver, the I and Q signals are treated independently in order to take advantage of the simpler 
formulae for the LLR values. 



3.1.4.3 Bit Probabilities 

[0063] From each received symbol, the bit probabilities for the three I dimension 
bits are computed as follows: 



LLR(ut)=log 



= log 



'<<JN 



(16) 



CP 
if? 



( 4 



LLR(u\) = \°% 



^V[-~{l k -a k Jj 



texp/'-/ 7 (/*- a *J; 



= log 



W-^-fr* - A 2 J] + ^V['~{l k - AsJ] + ^V[~~{l k - Aef] + ^[~{f k - A 7 Jj 



4<Jn *&n 4(j N ^CTtf 



(17) 



LLR( u ))=\o% 



i=l * <7n 



texp/--^ 7 (/-at) 2 ; 



= log 



* C7AT 



-an 



*<Tn *0"m ^<Jn 



(18) 



[0064] An analogous computation effort is required for the bits of the Q 
dimension, the I k being replaced with the Q k demodulated value in order to evaluate LLR(u4 k )> 
LLR(u 5 k )andLLR(u 6 k ). 
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[0065] The bit error probabilities are provided to the outer decoder where they are 
used by the outer decoder to detect the location of the erroneous bits and to selectively correct 
the erroneous bits. 

[0066] As discussed above, conventional outer decoders comprise a first stage 
that determines bit error information from the output bits of the inner decoder themselves, and a 
second stage that corrects bits in accordance with the bit error information. In accordance with 
the first preferred embodiment of the present invention, the first stage of the conventional outer 
decoder is replaced with a stage that generates a hard bit error decision for each bit using 
externally provided bit error probability information, such as by a thresholding procedure, and 
provides the bit error information to a second stage, such a conventional second stage, where bit 
errors are corrected in accordance with the bit error information. Those of ordinary skill in the 
art will be capable of modifying any of the conventional outer decoders of this type to accept 
% externally generated bit error probability information and generated bit error information 
5 therefrom for use in the second stage of the decoder. Therefore no further detailed discussion of 

ff 1 the outer decoder is provided here apart from the discussion in section 5 below. 

11 

1/1 3. 1 .4.4 Simulation Results 

O [0067] Figure 4 shows simulation results for 10,400 information bits with an S- 

fm type interleaver. A BER of 1 0" 7 can be achieved after 8 iterations at Et/No = 8.3 dB . 

0 

H 3.1.5 Coding And Modulation For 12 Bit/S/Hz Spectr al Efficiency. 

[0068] A second example in accordance with the first preferred embodiment 
utilizes a rate 12/14 coding scheme with 16384 QAM. 

3.1.5.1 Puncturing 

[0069] In order to obtain a rate 12/14 code, a puncturing pattern as shown in 
Table 3 is used. 

Table 3. Puncturing and Mapping for Rate 12/14 16384 QAM 



015.495282.2 



12 



Attorney Docket No. 042159-0120 



iniorniaTiori uir \%x) 


d, 


d 2 


d 3 


d4 


d 5 


d6 


d 7 


d 8 


d 9 


dio 


dn 


di 2 


pariiy oil {pj 


Pi 
























parity bit (q) 


























128AM symbol (I) 


(c 


li, d 2 , d 3 , d 


4d 5 , d6,p0 


128AM symbol (Q) 


(d 7 , d 8 , d 9 ,dio , du, d\ 2 , P7 ) 


16384 QAM symbol (I,Q) 


(di, d 2 , d 3 , d 4 d 5 , d6 , pi, d 7 , d 8 , d 9 ,dio , dn, di 2 , p 7 ) 



3.1.5.2 Modulation 

[0070] For a 16384 QAM constellation with points at -127A, -125A, -123A, - 
121 A, -119A, -117A, -115A, -113A, -111 A, -109 A, -107A, -105A, -103A, -101 A, -99A, -97 A, - 
95A, -93A, -91A, -89A, -87A, -85A, -83A, -81A, -79 A, -77A, -75A, -73A, -71A, -69A, -67 A, - 
65A, -63A, -61A, -59A, -57A, -55A, -53A, -51A, -49A, -47A, -45A, -43A, -41A, -39A, -37A, - 
35A, -33A, -31A, -29A, -27A, -25A, -23A, -21A, -19A, -17A, -15A, -13A, -11A, -9A, -7A, -5A, 
-3A, -A, A, 3A, 5A, 7A, 9A, 11 A, 13A, 15A, 17A, 19A, 21 A, 23A, 25A, 27A, 29 A, 31 A, 33A, 
35A, 37A, 39A, 41A, 43A, 45A, 47 A, 49A, 51A, 53A, 55A, 57A, 59A, 61A, 63A, 65A, 67A, 
69A, 71A, 73A, 75A, 77A, 79A, 81A, 83A, 95A, 87A, 89A, 91A, 93A, 95A, 97 A, 99A, 101A, 
103A, 105A, 107 A, 109 A, 111A, 113A, 115 A, 117A, 119A, 121 A, 123A, 125A, 127A, E av is: 

E av =5461A 2 (19) 

[007 1 ] It is assumed that at time k the symbol u k = (ui k , u 2 k , U3 k , Ot k , U5 k , U6 k , U7 k , 
ug k , UQ k , uio k , Un k , Ui 2 k , U]3 k , ui/) is sent though the channel. It is assumed that at time k the 
symbol u, k , u 2 k , u 3 k , u/, u 5 k , u 6 k and u 7 k modulate the I component and u 8 k , u 9 k , u 10 k u„ k , u I2 k , 
UB k and Uu k modulate the Q component of a 16384 QAM scheme, 

[0072] For a rate 12/14 code and 16384 QAM, the noise variance is: 

a ^ E J ^T J = 546U{ ^^y = 455.08^T ; (20) 

{.No J K No ) KNo) 

[0073] In order to study the performance of this scheme, a rate 6/7 turbo code and 
a 128 AM is used. The 16384 QAM scheme will achieve a similar performance in terms of bit 

13 

.2 



Attorney Docket No. 042159-0120 



error rate (BER) at twice the spectral efficiency, assuming an ideal demodulator. The puncturing 
and mapping scheme shown in Table 8 is for 12 consecutive information bits that are coded into 
14 encoded bits, therefore, one 16384 QAM symbol. The turbo encoder is a rate 12/14 turbo 
code, which in conjunction with 16384 QAM, gives a spectral efficiency of 12 bits/s/Hz. 

3.1.5.3 Bit Probabilities 

[0074] The 128AM symbol is defined as u k = (ui k , u 2 k , u 3 k , uA u 5 k , u<> k , u 7 k ), 
where ui k is the most significant bit and u 7 k is the least significant bit . The following set can be 
defined. 

[0075] bit-l-is-0 = {Ao ,Ai , A 2 , A 3 , A4 , A 5 , Ae , A 7 , Ag ,A 9 , A10 , An , An , 
A13 , A14 , A15, Ai6 An » A i8 , A19, A 20 , A 2 i , A 22 , A 23 , A 24 ,A 25 , A 26 , A 27 , A 28 , A 29 , A 30 , 
3 A31, A 32, A 33 , A 34 , A 35 , A 36 , A 37 , A 38 , A 39 , A40 ,An , A42 , A43 , A44 , A45 , A46 , A4 7 , A48, A49 , 
* A 50 , A51, A 52 , A 53 , A54 , A 55 , A 56 ,A 57 , A 58 , A 59 , Aeo , A6i , A 62 , Ae 3 } 

SJ [0076] bit-l-is-1 = {A 64 , Ae 5 , Ae 6 , A 67 , Ae 8 , A 69 , A 70 , A71 , A 72 ,A 73 , A 74 , A 75 , 

^ A 76 , A 77 , A 78 , A 79 , Aso ,A 8 i , A 82 , As 3 , A 84 , A 85 , As 6 , A 87 , A 88 ,Ag 9 , Ago , A91 , A 92 , A 93 , A 94 
0 , A 95 , A 96 , A 97 , A 98 , A 99 , A100, A101, A102, A103, A104, A105, A106, A107, Aim, A109, Ano , Am, Am, 

sjj Am, A114, A115, An6, A U7 , Alls, A119, A120, Am, Am, Al 23 , Ai 24 , Ai 25 , Ai 2 6 , Ai 27 } 

U [0077] bit-2-is-0 = {Ao Ai , A 2 , A 3 , A4 , A 5 , A 6 , A 7 , A 8 ,A 9 , A w , An , A i2 , 

A13 , A M , A15, Ai6 An , Ais , A», A 20 , A 2 i , A 22 , A 23 , A 24 ,A 25 , A 26 , A 27 , A 28 , A 29 , A 30 , 
A 3V , A 96 An , A 98 , A w , A100, A101, A102, A103, A104, A 10 5, A10& A i07 , Ai 0 g, Ai 09 , Ano , A m , A n2 , 
A113, A n4 , A115, A11& Am, An 8 , A119, A120, A m , Am, Am, Ai 24 , Am, Am, Am} 

[0078] bit-2-is-l = {A 32 ,A 33 , A 34 , A 35 , A 36 , A 37 , A 38 , A 39 , A40 Aa\ ,A42,Mi 
, A44 , A45 , A46 , At?, Ats, A49, A 50 , A51, A 52 , A 53 , A 54 , A 55 , A 56 ,A 57 , A 58 , A 59 , A 60 , A 6 i , A52 , 
A 63 , Am, Ae 5 , Aee, P*i, A 68 , Ae 9 , A 70 , A71, A 72 , A 73 , A 74 , A 75 , A 76 , A 77 , A 78 , A 79 , A 80 , Agi, A 82 , 
A 83 , As 4 , A 85 , A 8 6, Ag 7 , A 88 , A 89 , A90, A 9 i, A 92 , A 93 , A 94 , A 95 } 
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[0079] bit-3-is-0 = {Ao ,Ai , A 2 , A 3 , A4 , A 5 , As , A 7 , A 8 ,A 9 , Ai 0 , A 1 , A n , 
A13 , Ah , Ais, A48, A49, A 5 o , A51 , A52 , A 53 , A54 , A 55 , A 56 A57 , A 5 8 , A59 , A 6 o , A 6 i , A 62 , 
A 63 , Ae4, A65, Aee, A^, Aeg, A 69 , A 70 , A71, A 72 , A 73 , A 74 , A 75 , A 76 , A 77 , A 78 , A 79 , A m , A113, A n4 , 
A115, An6, Ain, Ana, A119, A120, A121, A122, A123, A124, A125, A126 , Ai 27 } 

[0080] bit-3-is-l = {Ai 6 An , A w , A19, A 20 , A 2 i , A 22 , A 23 , A 24 A25 , A 26 , A 27 , 

A 2 g , A 29 , A 30 , A31, A 32 ,A33 , A34 , A35 , A36 , A 37 , A 38 , A39 , A40 ,A41 , A42 , A43 , A44 , A45 , 

A46 , A47, A 80 , Agi , A 82 , A 83 , A 84 , A 85 , A 86 , A g7 , Ass As9 , A90 , A91 , A 92 , A 93 , A 94 , A 95 , 
A 9 6, A 97 , A 98 , A 99 , A100, A101, Aio2, A103, A104, A105, A106, A107, Aios, A109, Ano , Am } 

[008 1 ] bit-4-is-0 = {Ao ,Ai , A2 , A 3 , A4 , A 5 , Ae , A 7 , A 24 A25 , A 2 e , A 27 , A 28 , 
A 29 , A 30 , A31 A 32 A33 , A34 , A35 , A 36 , A 37 , A 38 , A39 , A 56 A57 , A 58 , A 59 , A60 , A6i , A6 2 , 
2 A 63) Ae4, A 65 , Aee , A6 7 , A 68 , Ae 9 , A 70 , A71 As As9 , A 90 , A 9 i , A 92 , A 93 , A 94 , A 95 , A 96 ,A 97 , 
A 98 , A 99 , A100, A101, A102, A103, A120, A121, Am, A123, A124, Ai2 5 , Ai 26 , Ai 27 } 

S [0082] bit-4-is-l = {A 8 Ai , A10 , An , An , A B , A M , A15 , Ai 6 An , Ai 8 , Aw, 

A 2 o , A 2 i , A 22 , A23 , A40 Ah , A42 , A43 , A44 , A45 , A46 , At? A48, A49 , A 50 , A51 , A 52 , A53 , 
O A 54 , A 55 , A 72 A73 , A 74 , A 75 , A 76 , A 77 , A 78 , A 79 ,Aso Asi , A 8 2 , A 83 , A g4 , As 5 , Age , A 87 , 
jjj A104, A05, Aioe, A107, Aios, A109, Ano , An, A112, A113, Aim, A15, An 6 , An 7 , An 8 , An 9 , } 

5 [0083] bit-5-is-0 = {Ao Ai , A 2 , A 3 , , A u , A13 , A M , A15 , Ai 6 An , Aig , A19, , 

A 28 , A 29 , A 30 , A31 , A 32 ,A 33 , A 34 , A 35 , A44 , A45 , A46 , A4 7 , A48, A49 , A 50 , A51 , , A 6 o , Aei , 
A 62 , A53 A64, A 65 , A 66 , A 67 , A 76 , A 77 , A 78 , A79 , A 80 As\ , Ml , A 83 , A 92 , A93 , A 94 , A 95 , A 96 , 
Ag?, A 98 , A 99 , Aios, A109, Ano, Am A112, Am, An 4 , An 5 , Am, Ai 25 , Ai 26 , Ai 27 } 

[0084] bit-5-is-l = {At , A 5 , Ae , A 7 , A 8 , A9 , Ai 0 , A 1, A 20 , A 2t , A 22 , A 23 , A 2 4 
A25 , A 26 , A 27 A 36 , A 37 , A 3 g , A39 , Aio A41 , A42 , A43 , A 52 , A53 , A 54 , A 55 , A 56 A57 , A 58 , 
A59 , Aes , Aeg , A 70 , A71 , A 72 ,A 73 , A 74 , A 75 , A 84 , Ags , A 86 , A 87 , A 88 As9 , A90 , A91, A100, 
A101, A102, A103, A104 A105, A106, A107, An6, Am, Aug, An 9 , A120, A m , A122, Ai 23 } 
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[0085] bit-6-is-0 = {A 2 , A 3 , A4 , A 5 , A10 , An , An , A13, Aw , A19, A 2 o , A21 , 

A 26 , A27 , A 28 , A 29 , A 34 , A 35 , A 36 , A 37 , A4 2 , A43 , A44 , A45 , A 50 , A 5 i , A 52 , A53 ,A 58 , A 59 , 
Aeo, Aei , Ae 6 , kei, Agg , A 69 A 74 , A75 , A 76 , A77 A 82 , A 83 , A 84 , A 85 , A 90 , A91 , A 92 , A 93 , A 98 , 
A 99 , A100, A101 A106, A107, A108, A109 A114, A115, An6, An? A122, A123, A124, A125} 

[0086] bit-6-is-l = {A 0 ,Ai A& , A 7 , A 8 ,A 9 , Ah , A15, Ai 6 ,An A 22 , A 23 , Au 
,A 25 , A 30 , A31 , A 32 ,A 33 A 38 , A 39 , A40 ,An A46 , A47, A4 8 , A4 9 A 54 , A 55 , A 56 ,A 57 A 62 , A63, Ae4, 
A 65 , A 70 , A 7 i , A 72 ,A73 , A 78 , A 79 , Ago ,Asi , A 86 , A 87 , A 88 ,Ag 9 , A 94 , A 95 A 96 ,A<>7, A102, A103, 
A104 , A105, Ano , Am , An 2 , An 3 , Aug, An 9 , A120, A121, A126 , A127 } 

[0087] bit-7-is-0 = {Ao , A 3 , A4 , A 7 , A 8 , An , A12, A 15 ,Ai 6 , Ai 9 , A 20 , A 23 , A 24 , 
A 27 , A 28 , A31 A 32 , A35 , A 36 , A 39 , A40, A43 , A44, A47 , A48, A51 , A 52 , A55 , A 56 , A 59 , Ago, Ae 3 , 
A64, As? , A6 8 , A71 , A 72 , A 75 , A 76 , A 79 , A 80 , A 83 , A 84 , Ag 7 , A 88 , A 9 i , A 92 , A 95 A 96 , A 99 , A100, 
A103, A104, A107, A108, Am , Am, An 5 , Au6, An 9 , A120, A123, A124, Ai 27 } 



[0088] bit-7-is-l = {Ai , A 2 , A 5 , As, A 9 , Aio, A !3 , A !4 , An , Ai 8 , A 2 i, A 22 , A 25 , 
A 26 , A 29 , A 30 , A33 , A 34 , A37 , A 38 , A41 , A42, A45 , A46 5 A49 , A 50 , A 53 , A 54 , A 57 , A 58 , A 6 i , A6 2 , 
A 65 , A66, A^9 , A 70 , A 73 , A74, A77 , A 78 , A 8 i , A 82 , A 85 , A 86 , A 89 , A 90 , A 93 , A 94 , A 97 , A 98 , A101, 
A102, Aio5 ? Aio6 ? Aio9, Ano, A113, A114, A117, Aug, Am, Ai 22 , Ai 25 , Ai 26 } 



[0089] From each received symbol, R k , the bit probabilities are computed as 



follows: 



LLR(u k i)^\og 



£ expf-/ T «^- A ||l 

\jebit-l-is-0 \ *CTN J 



(21) 



LLR( u k 2 )=log 



I ™p[-yr\\R k -M\\ 

^bit-2-is-l \ ^O'N J_ 

£ «pf~|ii*-^| 



^ AjZbit-2-is-O 



(22) 
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LLR(u k ,) = log 



A^bit-S-is-1 \. z cn y_ 



^ Aj£bit~3-is-0 



(23) 



iii?r M *;=io g 



2 exp 

A^bit-4-is-l 



I expf--L||^^,||] 

ebit-4-is-O \ ^CJN J 



(24) 



LLR(ut) = \og 



I exp[-/ T ||^- A || 

A^bit-5-is-l \ Z <JN ; 



bit-5-is-0 \ ^(JN J 



(25) 



LLR(ul) = log 



Z exp 

A,^bit-6~i s-1 



X ex P -T-y ^-^- 



(26) 



LZJV«;;=iog 



Al ebi t-l-is-l V ^^"A r /_ 



£ expf-/ T ||^-^||) 

Ajtbit-l-is-0 \ Z CFN J) 



(27) 



[0090] An analogous computation effort is required for the bits of the Q 
dimension, the I k being replaced with the Q k demodulated value in order to evaluate LLR(u 8 k ), 
LLR(u 9 k ), LLR(u 10 k ), LLR(u n k ), LLR(u 12 k ), LLR(ui 3 k ) and LLR(ui 4 k ). 

[009 1 ] The bit error probabilities are provided to the outer decoder where they are 
used by the outer decoder to generate bit error information indicating the location of the 
erroneous bits and to selectively correct the erroneous bits. 

[0092] As discussed above, conventional outer decoders comprise a first stage 
that determines bit error information from the output bits of the inner decoder themselves, and a 
second stage that corrects bits in accordance with the bit error information. In accordance with 
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the first preferred embodiment of the present invention, the first stage of the conventional outer 
decoder is replaced with a stage that generates a hard bit error decision for each bit using 
externally provided bit error probability information, such as by a thresholding procedure, and 
provides the bit error information to a second stage, such a conventional second stage, where bit 
errors are corrected in accordance with the bit error information. Those of ordinary skill in the 
art will be capable of modifying any of the conventional outer decoders of this type to accept 
externally generated bit error probability information and generated bit error information 
therefrom for use in the second stage of the decoder. Therefore no further detailed discussion of 
the outer decoder is provided here apart from the discussion in section 5 below. 

[0093] These probabilities are used by the outer decoder to detect the location of 
the erroneous bits. 

3.1.5.4 Simulation Results 

[0094] Figure 5 shows the simulation results for 31200 information bits. A BER 
of 10~ 7 can be achieved after 8 iterations at Eb/No = 28.25 dB. 

4. IDFT use for ADSL systems 

[0095] After the mapper, the signal is sent to the IDFT, shown as 5 in Figure 1 and 

to the channel, shown as 6 in Figure 1 . 

5. Use of the information by the Reed-Solomon outer decoder. 

[0096] The received signal is sent to the DFT block, 7 in Figure 1, and to the 
inner decoder 7 in Figure 1 . 

[0097] The probabilities in equations (16), (17) and (18) for the case of 4 bit/s/Hz 
and the probabilities of equations (21), (22), (23), (24), (25), (26) and (27) for the case of 12 
bit/s/Hz are used for the RS decoder, shown as 9 in Figure 1, in the following way: 

[0098] The reliability of the received data is determined with the reliability of the 
MAP decoder. These data and associated bit error probabilities are carried through the 
deinterleaver placed between the inner decoder and the outer decoder. The Reed-Solomon uses 
as indication of error placement the worst of the bit error probabilities. Note that the MAP 
decoder may assign poor probabilities to all data associated with a frame . 
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[0099] While the first preferred embodiment utilizes turbo coding for the inner 
encoder and RS for the outer decoder, it will of course work with any soft-output inner encoder 
that provides bit error probabilities and outer encoders that utilize bit error probability 
information. This include turbo code base Maximum a Posteriori (MAP), Logarithmic MAP 
(LOGMAP), Maximum LAGMAP (MAXLOGMAP), soft-output Viterbi Algorithm (SOVA), 
Turbo Block Codes, as well as inner encoder using a single convolutional code as such trellis 
encoding of G.992.1 and G.992.2. It is recognized that the use of soft-output decoders on this 
non-turbo encoder will also give the same benefit. The significant point to recognize is the use of 
the inner soft-output decoder and that the outer decoder can take advantage of this information. 

[00 1 00] Accordingly, in accordance with the first preferred embodiment, there is a 
process for decoding a symbol stream with forward error correction to produce an information 
bit stream. This process is illustrated in Figure 6. A symbol stream is received 60 from a 
transmitter. The symbol stream is decoded 62 in an inner decoder using soft-output decoding to 
provide an output bit stream and associated bit error probabilities. The bit error probabilities and 
the output bit stream are provided 64 to an outer decoder, and the outer decoder produces 66 an 
information bit stream from the output bit stream using the bit error probabilities. 

6. Second preferred embodiment using inner sum-product coding 

[00 101] In a second preferred embodiment, a sum-product algorithm inner encoder 
and decoder, such as LDPC coders, are used in a transmitter and receiver, respectively. The 
second preferred embodiment differs from the first preferred embodiment in that the sum- 
product inner decoder provides bit error information for its output bit stream, i.e. information 
indicating the position of each erroneous bit that requires correction by the outer decoder. The 
bit error information is provided to the outer decoder and used to select bits from the inner 
decoder output stream for correction in the outer decoder. This embodiment is preferred for its 
simplicity of implementation. 

[00 1 02] Accordingly, in accordance with the second preferred embodiment, there 
is a process in a transmitter for encoding a symbol stream with forward error correction from an 
information bit stream. As shown in Figure 7, an information bit stream is received 70 and is 
encoded in an outer encoder 72. The output of the outer encoder is encoded 74 in an inner 



!.2 



19 



mm. 



Attorney Docket No. 042159-0120 

encoder using sum-product encoding. A symbol stream is then produced 76 by mapping an 
output bit stream of the inner encoder. 

[00 1 03] Further, in accordance with the second preferred embodiment, there is a 
process in a receiver for decoding a symbol stream with forward error correction to produce an 
information bit stream. As shown in Figure 8, a symbol stream is received 80 from a transmitter. 
The symbol stream is decoded 82 in an inner decoder using sum-product decoding to provide an 
output bit stream and bit error information for the output bit stream. The bit error information 
and the output bit stream are provided 86 to an outer decoder, and the outer decoder produces 88 
an information bit stream from the bit error information and the output bit stream. 

[00 1 04] Further embodiments of the invention pertain to a transmitter or receiver 
that performs processing as described above. Typically such transmitter or receiver will 
comprise at least one processor and storage media coupled to the at least one processor and 
y containing programming code for performing processing as described above. 
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